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ABSTRACT 

In the constructivist approach, various self-assessment techniques are being developed to 
enable students to assess themselves in the learning process. The purpose of the study is to 
investigate relation between students' preferences in assessment process and students' 
performances. The study was conducted with 67 sophomore students enrolled in Department 
of Computer Education and Instructional Technologies at a State University. The study was 
carried out in "Measurement and Evaluation in Education" course. At the beginning, Moodle 
LMS was used to define the preferences of students about their own assessment criteria 
(discussion, quiz, assignment and viewing of course content). Throughout the process, 
students were received the course instructional package in the classroom. Then they were 
asked to fill the assessment activities on the LMS. Students' actual performances in online 
activities in terms of their preference about assessment criteria was calculated as students 
course achievement scores. The mean value of the scores and the standard deviation were 
guided us to divide the participants into three groups (unsuccessful, moderately successful, 
successful) considering their means and standard deviations. Then, the preferences of 
students and their academic achievements were associated in each group. As a result, various 
criteria were come to front in both successful and unsuccessful groups. Surprisingly, none of 
the students preferred viewing course content and participating in discussions as the highest 
assessment criterion. Besides, it was found that all the students in successful group preferred 
viewing course content as lowest assessment criterion. The results indicated that, there were 
no prominent criteria in the relations between the preferences of students about assessment 
process and the academic performances. However, most of the students in unsuccessful group 
performed better in assignment although they did not preferred the assignment as the highest 
assessment criterion. At the end of the study, we noticed that while considering the criterion 
in the assessment process, taking students' perspectives and preferences into consideration 
motivated students positively and had somehow related to their academic achievements. 
Thus, it is hoped that the study can provides an insight to future studies to enrich assessment 
activities with giving responsibilities to students in learning, especially in assessment process. 
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INTRODUCTION 


The constructivist approach highlight students learning, tries to understand their 
individual improvements on the basis of their interests and habits, and aims to create an 
effective classroom environment, activities and methods (Richardson, 2003). Getting 
students to centre in learning process, students may construct meaningful knowledge 
based on their prior knowledge and experiences without strict classroom rules (Watson, 
1996). Constructivist approach tends to use various teaching techniques and methods by 
getting students to centre in classroom. In evaluation stage, it declines the necessity of 
alternative evaluation methods to evaluate students' knowledge and abilities accurately 
(Ministry of National Education, 2006). Since, students construct their own knowledge it 
enables students to provide their own assessment and evaluation which is one of the 
indispensable component of the educational process (Kottail, 2009). In order to provide 
opportunities for students in the assessment process, teachers carry out various activities 
to direct the educational process according to students' demands. Therefore, students are 
able to do act new roles and have their own interpretations about learning. In relation to 
this, self-assessment provides individual routing for each student and decreases some of 
the burdens on teachers and eliminates the barriers between teachers and students 
(McConnell, 2006). As the students are decision makers about their own learning and 
assessment process, they feel the sense of responsibility and tend to act with this sense 
(McConnell, 2000). 

Some research studies suggest that using different assessment methods within the 
framework of constructivist approach provide a positive contribution to their academic 
achievements and motivations and improve their thinking skills (Bahar, Nartgun, Durmus, 
& Bicak, 2008; Duran, Mihladiz, & Balliel, 2013; Duran, 2013). In this respect, different 
assessment methods are being developed for students to evaluate them in learning 
process. Moreover, it is thought that their active participation in decision-making stage in 
assessment criterion and evaluation process is an important component for their real life 
preparation (Cukusic, Garaca, & Jadric, 2014). However, while implementing the self- 
assessment methods, students may assess themselves by putting forward certain 
criterion, students may act unilaterally and teachers cannot trust students much in some 
cases (Duran, Mihladiz, & Balliel, 2003; Erdal, 2007; Silberman, 1996). In this case, the 
necessity of reducing teachers' concerns is revealed while giving responsibilities to 
students in the assessment process. It may be considered as sharing the assessment role 
of teacher in the learning process, but several studies addressed that students should act 
in the whole process of learning. Thus, to determine assessment criteria in a systematic 
way may contribute to the quality of the assessment process. Planning the assessment 
process through students' preferences may begin with defining the preferences, and 
continue with assessing the activities through these preferences. Because of the 
limitations in gathering students' preferences, many efforts have been provided to 
transfer this process in to online environment (Graff, 2003; Barrett, 2004). In this sense, 
the assessment activities generally have been conducted in multiple choice forms (Chang, 
Liang, & Chen, 2013; Henly, 2003). Reviewing these forms makes teachers' tasks easier 
and so an objective evaluation can be available. This alternative assessment named as 
online self-assessment provide positive contribution to students' academic performances 
(Chang, Liang, & Chen, 2013; Cukusic, Garaca, & Jadric, 2014; Kaklauskas et al., 2010). 

Conducted studies about online assessment have grown rapidly during the past decade 
(Zuckweiler, 2012). Despite the growing rapidly and several benefits about online 
assessment, empirical studies are still needed to explore the benefits of the online 
assessment methods (Spivey & McMillan, 2014). For instance, in their study Russell et al. 
(2006) assert that an online learning environment enables to support learning, 
collaborative learning, and feedback between students and teachers. Also DeSouza and 
Fleming (2003) noticed that online assessment by supporting the learning process can be 
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used in online learning environments. Moreover, online assessment can enhance learning, 
facilitate collaboration, and improve sense of community (Morgan & O'Reilly, 2001). 

Moreover, Buchanan (2001) emphasised that online assessment methods effect academic 
achievements positively even if students' face to face participation in courses are low. 
Furthermore, some research studies suggested giving roles to students in the assessment 
process by focusing on their motivation is getting higher (Birenbaum, 2007; Kaklauskas 
et al., 2010; Lai, & Hwang, 2015). Birenbaum, (2007) pointed out that students' 
assessment preferences play a crucial role for understanding learning process. For 
example, Traub and McRury (1990) assert that students prefer multiple choices because 
these tests are easy to prepare and take and bring higher points. Thus they generally 
prefer to learn with studying for exams. 

Online assessments are generally carried out through LMSs. Since, LMSs provide valuable 
affordances for assessing the students such as quizzes, discussions, navigation patterns, 
assignment, etc. Research studies generally addressed how to design and apply these 
activities on LMSs (Rapuano & Zoino, 2006; Cavus, Uzunboylu & Ibrahim, 2007). The 
effects of students' roles in the online assessment process may provide insights for 
instructors or instructional designers to construct efficient learning environments and to 
define the role of assessment in the learning process. Considering the potential of 
students' preferences in assessment, in this study; we purposed to investigate the 
relation between students' preferences about assessment criteria and their performances. 
Thus, the following research problem was guided to the study. 

Within the scope of academic performances; to what extend did the students' assessment 
preferences take place during the learning process? 

METHODOLOGY 

Participants 

This descriptive study involves sixty-seven (n=67) sophomore voluntary university 
students at Computer Education and Instructional Technologies (CEIT) program from a 
state university in Turkey. We used convenience-sampling method to select the 
participants. The study was conducted in "Measurement and Evaluation in Education" 
course during 10 weeks. During the process, students applied some online activities using 
Moodle Learning Management System including quizzes, discussions, assignments, and 
viewing course contents. They have experiences on using Moodle components but they 
did not participate an online assessments process. 

Research Process 

In the research process, firstly participants were registered in Moodle LMS. Then, an 
online form was submitted to the participants to determine to what extend the online 
assessment activities (quizzes, discussions, assignments, and viewing course contents) 
effect on their course achievement in Moodle. Maximum rate was stated as 40% for all 
activities. Students assigned their preferences as effect rates on course achievement 
totallylOO points. Participants were informed that these points will be used as course 
achievement scores. They were also warned to be careful on assigning the meaningful 
rates including their real opinions by considering their qualifications and expectations in 
such activities. One student's preference about assessment criterion rates is illustrated 
below: 
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Figure 1. A sample for a student's preferences 


As seen in Figure 1, the student preferred "assignment" activity as the highest 
assessment criterion (40%) and "quiz" activity as lowest assessment criterion (%10), 
totally 100 points. Furthermore, online activities uploaded in LMS for each week. In the 
study, students found opportunity for discussing on issues related to course content, 
participating in activities such as quizzes, assignments, viewing course content during 10 
weeks. Each student's log data was stored automatically by Moodle for activities that they 
conducted. 

Students' actual performances in online activities in terms of their preference about 
assessment criteria was calculated as students course achievement scores. The mean 
value of the scores and the standard deviation were guided us to divide the participants 
into three groups (unsuccessful, moderately successful, successful) considering their 
means and standard deviations. Then, a relation was investigated between students' 
preferences (SPr), students' performances (SPe) and their course achievement. While 
performing this, it was taken into consideration that they were active or not during the 
process. Active students can show high participation level in LMS and this was 
determined from students' log data and points about online activities. The points of online 
activities were calculated by norm-referenced evaluation. And also, viewing course 
content is important for determining that students are active or not. 

The research process including the technical infrastructure, implementation, collecting 
data and data analysis phases that are shown in Figure 2: 
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TECHNICAL 

INFRASTRUCTURE 


IMPLEMENTATION 

1. Phase: 

> Registration of students to 
Moodle 

> Adding online assessment 
form to the system 

- 

2. Phase: 

> Presenting assessment 
form to students. 

> Adding discussion, quiz, 
assignment and course 
content to system weekly. 


* 



Figure 2. Research process 

First step of this process was completed before the research started and implementation 
phase was carried out over 10 weeks. Collecting data phase continued during the study. 

Data Collection and Analysis 

In the data collection phase, data obtained from Moodle LMS were interpreted using 
descriptive analysis technique. Thanks to Moodle LMS which stores all students' log data 
about online activities, was the repository of data for each activity. Additionally, the 
scores from the activities calculated as course achievement scores at the end of the 
process which was from 0 to 100. Students were grouped according to these scores in 
order to examine the preferences and performances in the successful, moderately 
successful and unsuccessful groups. It is determined that how many participants prefer 
quiz, assignment, viewing course content and discussion criterion to be assessed and how 
many participants show performances in the same direction of preferences. The findings 
were presented through students' preferences including their lowest and highest rated 
assessment criteria. Thus, to find out how many participants prefer which activities as the 
highest and lowest rated assessment criteria, norm-references evaluation method was 
conducted. 

RESULTS 

For understanding relation between SPr and SPe, we classified students into groups 
aspect of course achievement scores. Participants' scores ranged from 21 to 93 points. 
The arithmetic mean of the achievement test was 69,76 (SD=12,79). The participants 
were classified in three groups by subtracting standard deviation from arithmetic mean or 
adding standard deviation to arithmetic mean: (1) unsuccessful group (under 56,96), (2) 
moderately successful group (56,96 to 82,55) and, (3) successful group (over 82,55). 
Scores of the participants included in unsuccessful, moderately successful, and successful 
groups ranged between 21 and 56, 58 and 79, 84 and 96 respectively. 
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11 of 67 participants are in successful group, 50 of 67 are in moderately successful group 
and 6 of them are in unsuccessful group. In this study, we focused whether SPr and SPe 
differentiate in terms of success groups or not. The results of the study were as follows. 

Relationships between Groups and Assessment Criterion 

Relation among SPr, SPe and, the preferred highest assessment criterion in groups 

In Figure 3, the numbers of students who chose online activities as assessment criterion 
for students affecting course achievement in highest rate is illustrated. 



Successful Group 

Moderately 
Successful Group 

Unsuccessful Group 
I I No students 


Figure 3. Number of Participants in terms of SPr and SPe in Groups 


As shown in Figure 3, it is seen that none of the students preferred to be assessed as 
highest rate in online discussion and viewing course content. As the number of 
participants choosing quiz and assignments is 11 in successful group, this number is six in 
unsuccessful group. Although there are not any students preferring assignment in 
unsuccessful group, four students perform better in this direction. 42 of 50 moderately 
successful group members preferred quiz as the highest assessment criterion. Moreover, 
as indicated in Figure 3, as no participants preferred the viewing course content to be 
assessed as the highest assessment criterion, only 14 students performed better in this 
direction. When analysing students' log data in LMS, it was noticed that weekly mean 
duration of viewing course content is 58,9 minutes. 

Overall, when viewing Figure 3 aspect of SPr and SPe, it emerges that only 19 students 
preferred the highest assessment criterion and show performance in the same direction 
as well. While 18 students show performance about preferences in moderately successful 
and successful group, only one student shows it in unsuccessful group. 

Relation among SPr, SPe and, the preferred lowest assessment criterion in groups 

The numbers of students who chose online activities as assessment criterion for students 
affecting course achievement in lowest rate is illustrated in Figure 4. When examining the 
Figure 4, it is seen that quiz and assignment activities were not preferred as the lowest 
assessment criterion by any of the students. All the students in successful group preferred 
the viewing course content as the lowest assessment criterion. There are only five of all 
students in successful group perform better about preferences in the viewing course 
content. 37 of 50 moderately successful group members stated that they preferred the 
course content activity as the lowest assessment criterion. 
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Successful Group 

Moderately 
Successful Group 


Unsuccessful Group 
]] No students 


Figure 4. Number of Participants in terms of SPr and SPe in Groups 


Overall, when analysing Figure 4 aspect of SPr and SPe, it emerges that only 31 students 
preferred the lowest assessment criterion and show performance in the same direction as 
well. While 29 students show performance about preferences in moderately successful 
and successful group, only two students show it in unsuccessful group. 


CONCLUSION AND DISCUSSION 


As a result, it was found that majority of the participants were in the successful group. As 
a SPr various criteria were come front in the groups. Assignment was mostly preferred as 
highest SPr in successful group, but no one preferred assignment criteria as the highest 
SPr in unsuccessful group. It is generally known that assessment has an important role in 
the learning processes and new teaching methods (Brown et al. 1994; Gibbs 1999; 
Scouller 1998). 

The criteria using the course content and discussion were not preferred as the highest SPr 
by both successful and unsuccessful groups. Course content criterion is the lowest SPr by 
both successful and unsuccessful group. When students have the chance to decide on 
their own assessment process, they feel more responsibility and tend to act with the 
sense of this responsibility (McConnell, 2000). In addition, the criteria about use of 
course content were preferred with expecting the lowest score by all groups. It reflects 
that most of the students could not give up traditional assessment methods and their old 
habits about not spending much time within the context in the system. Similarly, Gijbels 
and Dochy (2006) pointed out that the perception of a too heavy workload can arguably 
be an explanation for decreased preference for assessment criteria and Gunnar (2008) 
addressed that students do not track the courses in the LMSs if they are not meaningful 
for them. 

On the other hand, taking students' preferences in the assessment process is partially 
positively effected on students' academic achievements. Some other studies using online 
self-assessment techniques also found similar effects on students' achievements 
(Cukusic, Garaca, & Jadric, 2014; Chang, Liang, & Chen, 2013; Kaklauskas, 2010). 
Defining the assessment criteria through students' preferences bring out some 
unexpected achievement scores for students. For instance, students who preferred to be 
assessed with giving high rates to quiz, discussion and assignments, only students' who 
preferred assignments could get high grades in assignments. Surprisingly, some other 
students who did not expect higher scores from quizzes and assignments also got their 
highest scores from these activities. In addition, it was observed that quiz and the 
assignment were the most preferred activities for highest SPr. Since they were 
accustomed to be assessed through quizzes, exams or assignments in their educational 
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life, the result can be thought as a reflection from their previous experiences. However, it 
was found that students could not get the highest grade from their highest grade 
criterion that they preferred. Most of the students got the highest grade from assignment 
criterion although they preferred the quiz criterion as the highest rate. This is possibly 
because of their conventional assessment habits. In this sense, Struyven Dochy and 
Janssens (2006), argues that the way in which a student perceives about learning and 
studying, follow the way in which he tackles assignments and assessment tasks. 

Since constructivist learning approach suggest students acting in the assessment in the 
instructional process, it is not easy to control students' assessment behaviours. Giving 
responsibility may support students' meaningful learning, but students sometimes cannot 
know the activities that they are better. This is may be due to their study habits or their 
experiences which they brought from their conventional courses. The study provided 
some clues that it is difficult for students to give up their habits from behaviour approach. 
Using online environment for assessment process is also useful to give responsibilities to 
the students. In addition, LMSs provide affordances for instructor to organize the 
assessment process using online environments. 

Consequently, it is concluded that as the criteria for taking students' perspectives into 
account and their own preferences have a motivating role on students due to the idea of 
determining their own assessment process. The main difficulty for students is to estimate 
their real abilities. In this sense, instructors by reflecting their experiences may help 
students in the assessment process. Another conclusion may be drawn from the study is, 
there is no directly relation occurred between students' preferences and academic 
performances. Future studies may be focused on some qualitative data to interpret the 
reasons for why majority of students prefer classical assessment techniques. 
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